A broad assessment of covid-19 vaccine safety using tree-based data-mining in the vaccine safety datalink.

BACKGROUND: Except for spontaneous reporting systems, vaccine safety monitoring generally involves pre-specifying health outcomes and post-vaccination risk windows of concern. Instead, we used tree-based data-mining to look more broadly for possible adverse events after Pfizer-BioNTech, Moderna, and Janssen COVID-19 vaccination. METHODS: Vaccine Safety Datalink enrollees receiving ≥1 dose of COVID-19 vaccine in 2020-2021 were followed for 70 days after Pfizer-BioNTech or Moderna and 56 days after Janssen vaccination. Incident diagnoses in inpatient or emergency department settings were analyzed for clustering within both the hierarchical ICD-10-CM code structure and the post-vaccination follow-up period. We used the self-controlled tree-temporal scan statistic and TreeScan software. Monte Carlo simulation was used to estimate p-values; p = 0.01 was the pre-specified cut-off for statistical significance of a cluster. RESULTS: There were 4.1, 2.6, and 0.4 million Pfizer-BioNTech, Moderna, and Janssen vaccinees, respectively. Clusters after Pfizer-BioNTech vaccination included: (1) unspecified adverse effects, (2) common vaccine reactions, such as fever, myalgia, and headache, (3) myocarditis/pericarditis, and (4) less specific cardiac or respiratory symptoms, all with the strongest clusters generally after Dose 2; and (5) COVID-19/viral pneumonia/sepsis/respiratory failure in the first 3 weeks after Dose 1. Moderna results were similar but without a significant myocarditis/pericarditis cluster. Further investigation suggested the fifth signal group was a manifestation of mRNA vaccine effectiveness after the first 3 weeks. Janssen vaccinees had clusters of unspecified or common vaccine reactions, gait/mobility abnormalities, and muscle weakness. The latter two were deemed to have arisen from confounding related to practices at one site. CONCLUSIONS: We detected post-vaccination clusters of unspecified adverse effects, common vaccine reactions, and, for the mRNA vaccines, chest pain and palpitations, as well as myocarditis/pericarditis after Pfizer-BioNTech Dose 2. Unique advantages of this data mining are its untargeted nature and its inherent adjustment for the multiplicity of diagnoses and risk intervals scanned.

Tree-based data mining for safety assessment of first COVID-19 booster doses in the Vaccine Safety Datalink.

BACKGROUND: The Centers for Disease Control and Prevention's Vaccine Safety Datalink (VSD) has been performing safety surveillance for COVID-19 vaccines since their earliest authorization in the United States. Complementing its real-time surveillance for pre-specified health outcomes using pre-specified risk intervals, the VSD conducts tree-based data-mining to look for clustering of a broad range of health outcomes after COVID-19 vaccination. This study's objective was to use this untargeted, hypothesis-generating approach to assess the safety of first booster doses of Pfizer-BioNTech (BNT162b2), Moderna (mRNA-1273), and Janssen (Ad26.COV2.S) COVID-19 vaccines. METHODS: VSD enrollees receiving a first booster of COVID-19 vaccine through April 2, 2022 were followed for 56 days. Incident diagnoses in inpatient or emergency department settings were analyzed for clustering within both the hierarchical ICD-10-CM code structure and the follow-up period. The self-controlled tree-temporal scan statistic was used, conditioning on the total number of cases for each diagnosis. P-values were estimated by Monte Carlo simulation; p = 0.01 was pre-specified as the cut-off for statistical significance of clusters. RESULTS: More than 2.4 and 1.8 million subjects received Pfizer-BioNTech and Moderna boosters after an mRNA primary series, respectively. Clusters of urticaria/allergy/rash were found during Days 10-15 after the Moderna booster (p = 0.0001). Other outcomes that clustered after mRNA boosters, mostly with p = 0.0001, included unspecified adverse effects, common vaccine-associated reactions like fever and myalgia, and COVID-19. COVID-19 clusters were in Days 1-10 after booster receipt, before boosters would have become effective. There were no noteworthy clusters after boosters following primary Janssen vaccination. CONCLUSIONS: In this untargeted data-mining study of COVID-19 booster vaccination, a cluster of delayed-onset urticaria/allergy/rash was detected after the Moderna booster, as has been reported after Moderna vaccination previously. Other clusters after mRNA boosters were of unspecified or common adverse effects and COVID-19, the latter evidently reflecting immunity to COVID-19 after 10 days.

Changes in incidence rates of outcomes of interest in vaccine safety studies during the COVID-19 pandemic.

BACKGROUND: The COVID-19 pandemic caused an abrupt drop in in-person health care (inpatient, Emergency Department, outpatient) and an increase in telehealth care, which poses challenges in vaccine safety studies that identify outcomes from in-person encounters. We examined the changes in incidence rates of selected encounter-based outcomes during the COVID-19 pandemic. METHODS: We assembled a cohort of members from 8 Vaccine Safety Datalink sites from January 1, 2017 through December 31, 2020. Using ICD-10 diagnosis codes or laboratory criteria, we identified 21 incident outcomes in traditional in-person settings and all settings. We defined 4 periods in 2020: January-February (pre-pandemic), April-June (early pandemic), July-September (middle pandemic), and October-December (late pandemic). We defined four corresponding periods in each year during 2017-2019. We calculated incidence rates, conducted difference in difference (DiD) analyses, and reported ratios of incidence rate ratios (RRR) to examine changes in rates from pre-pandemic to early, middle, and late pandemic in 2020, after adjusting for changes across similar periods in 2017-2019. RESULTS: Among > 10 million members, regardless of setting and after adjusting for changes during 2017-2019, we found that incidence rates of acute disseminated encephalomyelitis, encephalitis/myelitis/encephalomyelitis/meningoencephalitis, and thrombotic thrombocytopenic purpura did not significantly change from the pre-pandemic to early, middle or late pandemic periods (p-values ≥ 0.05). Incidence rates decreased from the pre-pandemic to early pandemic period during 2020 for acute myocardial infarction, anaphylaxis, appendicitis, Bell's palsy, convulsions/seizures, Guillain-Barré syndrome, immune thrombocytopenia (ITP), narcolepsy/cataplexy, hemorrhagic stroke, ischemic stroke, and venous thromboembolism (p-values < 0.05). Incidence rates of Bell's palsy, ITP, and narcolepsy/cataplexy were higher in all settings than in traditional in-person settings during the three pandemic periods (p-values < 0.05). CONCLUSION: Rates of some clinical outcomes during the pandemic changed and should not be used as historical background rates in vaccine safety studies. Inclusion of telehealth visits should be considered for vaccine studies involving Bell's palsy, ITP, and narcolepsy/cataplexy.

U.S. Population-Based background incidence rates of medical conditions for use in safety assessment of COVID-19 vaccines.

The Coronavirus Disease 2019 (COVID-19) pandemic has had a devastating impact on global health, and has resulted in an unprecedented, international collaborative effort to develop vaccines to control the outbreak, protect human lives, and avoid further social and economic disruption. Mass vaccination campaigns are underway in multiple countries and are expected worldwide once more vaccine becomes available. Some early candidate vaccines use novel platforms, such as mRNA encapsulated in lipid nanoparticles, and relatively new platforms, such as replication-deficient viral vectors. While these new vaccine platforms hold promise, limited safety data in humans are available. Serious health outcomes linked to vaccinations are rare, and some outcomes may occur incidentally in the vaccinated population. Knowledge of background incidence rates of these medical conditions is a critical component of vaccine safety monitoring to aid in the assessment of adverse events temporally associated with vaccination and to put these events into context with what would be expected due to chance alone. A list of 22 potential adverse events of special interest (AESI), including neurologic, autoimmune, and cardiovascular disorders, was compiled by subject matter experts at the U.S. Food and Drug Administration and the Centers for Disease Control and Prevention. The most recently available U.S. background rates for these medical conditions, overall and by age, sex, and race/ethnicity (when available), were sourced from reported statistics (data published by medical panels/ associations or federal government reports), and literature reviews in PubMed. This review provides estimates of background incidence rates for medical conditions that may be monitored or studied as AESI during safety surveillance and research for COVID-19 vaccines and other new vaccines.